Spike-based cross-entropy method for reconstruction
نویسندگان
چکیده
Most neural optimization algorithms use either gradient tuning methods or complicated recurrent dynamics that may lead to suboptimal solutions or require huge number of iterations. Here we propose a framework based on the cross-entropy method (CEM). CEM is an efficient global optimization technique, but it requires batch access to many samples. We transcribed CEM to an online form and demonstrated by computer simulations. We argue that this framework allows for neural implementation and suggests a novel computational role for spikes in real neuronal systems. & 2008 Elsevier B.V. All rights reserved.
منابع مشابه
Information through a Spiking Neuron
While it is generally agreed that neurons transmit information about their synaptic inputs through spike trains, the code by which this information is transmitted is not well understood. An upper bound on the information encoded is obtained by hypothesizing that the precise timing of each spike conveys information. Here we develop a general approach to quantifying the information carried by spi...
متن کاملCompetitive spiking and indirect entropy minimization of rate code: efficient search for hidden components.
Our motivation, which originates from the psychological and physiological evidences of component-based representations in the brain, is to find neural methods that can efficiently search for structures. Here, an architecture made of coupled parallel working reconstruction subnetworks is presented. Each subnetwork utilizes non-negativity constraint on the generative weights and on the internal r...
متن کاملBiological Neural Network Structure and Spike Activity Prediction Based on Multi-Neuron Spike Train Data
The micro-scale neural network structure for the brain is essential for the investigation on the brain and mind. Most of the previous studies typically acquire the neural network structure through brain slicing and reconstruction via nanoscale imaging. Nevertheless, this method still cannot scale well and observation on the neural activities based on the reconstructed neural network is not poss...
متن کاملBitmap reconstruction for document image compression
We introduce a pattern matching algorithm and a bitmap reconstruction method used in document image compression. This pattern matching algorithm uses the cross entropy between two patterns as the criterion for a match. We use a physical model which is based on the nite resolution of the scanner (spatial sampling error) to estimate the probability values used in cross entropy calculation. The ma...
متن کاملTrial-Shuffle Method for Inferring Information Transfer in Spike-train Data Sets
Understanding information processing in the brain requires the ability to determine the functional connectivity between the different regions of the brain. We present a method using transfer entropy to extract this flow of information between brain regions from spike-train data commonly taken in neurological experiments. Transfer entropy is a statistical measure based in information theory that...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Neurocomputing
دوره 71 شماره
صفحات -
تاریخ انتشار 2008